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ABSTRACT 

The Library Education Experimental Project (LEEP) 
involved the establishment of a computer-based laboratory for library 
science students, utilizing the Library of Congress MARC 
(Machine-Readable Cataloging) magnetic tapes. Assignments in several 
classes (reference and bibliography, cataloging, and technical 
services) involved the use of these tapes and special purpose 
programs at the Syracuse University Computing Center, With the aid of 
these computer programs, over two hundred students in eight different 
courses (repeated for three semesters) were able to search and 
retrieve catalog records for current literature, to process their own 
cataloging assignments or examine the characteristics of the Library 
of Congress cataloging^ The laboratory's usefulness was evaluated by 
the students and the faculty at the end of each semesters The entire 
laboratory (computer program, data bases, class assignments, user 
manuals, etc.) has been fully described to other library schools at a 
special institute and via a newsletter and report series. Appended 
are the results of a survey of program languages and computing 
facilities available to library schools and a bibliography of LEEP 
publications, (Author/JB) 
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Preface 



Library education today is undergoing dramatic changes. The 
Impact of technology, the use of the computer, and changes In li- 
braries and education all contribute to this. This project at 
Syracuse University benefited greatly from cooperative efforts 
with people engaged In these developments at the Library of Congress 
Information Systems Office, IBM (Syracuse office), the Five Ass;?cla- 
ted University Libraries, the Syracuse University Cotoputlng Center 
and the Center of Instructional Communication. Without their help, 
this project could not have been undertaken or so successfully com- 
pleted. 

In turn. It is possible that we contributed something to the 
field of library education. Assignments for a third of the courses 
In the library science curriculum now Involve student use of a com- 
puter-based catalog. The potential of automation for libraries Is a 
real concept for the student and the faculty of the school. The com- 
puter Is seen as a tool for library research. 
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Sumaary 



Scope and Objectives 

1. To use the Library of Congress HARC (tdachlne Readable Cataloging) 
data base and related programs In a library school environment 
for teaching and research purposes in order to uncover problems 
in system development, file maintenance and related natters. 

2. To develop a computer-based laboratory at Syracuse University 
Computing Center which library science students could use with 
a minimum of Instruction and programming knowledge on an every- 
day basis. 

3. To evaluate such an effort (1 and 2 above) to determine Its use- 
fulness and applicability to other library science programs across 
the country. 

A. To continue the effort over several semesters to 

necessary changes in data bases, programs, cooqputer environment, 
faculty and student reactions. 

5. To perform background studies on HARC as a file and as a set of 
individual records of cataloging practice. 

6. To experiment with data bases related to IIARC (e.g. LC List of 
Subject Headings, Z Classification Schedule) 







Highlights 

1. LC/llARC: Ve created several data bases from the original IIARC 
Pilot Project data base of 48,190 records. By the conclusion 
of this grant period, we had a 9,000-volume computer-based 
catalog which was used by students for subject or reference 
retrieval assignments by means of an IBH software package called 
DPS (Document Processing System). 

The entire MARC data base was accessible via another program by IC 
card ntinber. Other programs were written to provide additional 
access to liARC files. For example, printed catalogs of the en- 
tire MARC file in classified (LC and DC) order and main entry 
order were produced. 

More than half of the computer and programming staff's time 
(5,400 hours total) was spent in data file processing or data 
retrieval. 
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2. SLS/llARC Laboratory ; Batched comjputer runs from various classes In 
the school were run on a seml<n/eekly or dally basis when necessary* 
FeiT difficulties were encountered by the students* Job prepara- 
tion by the staff or the students consumed a minimal amount of 
time. 

3* Evaluation ; The Mlnnowbrook Institute on LEEF, held In October 
1969, and the semester reviews by the SLS faculty and student 
body were our principal evaluation techniques* These reviews 
highlighted the values, costs, and modifications which are needed 
to keep such a laboratory viable and useful. 

4* Experimentation and Research with MARC ; The class assignments In 
reference, bibliography, cataloging, technical services and In- 
formation systems changed each semester as the students and 
faculty became more oriented to the computer facility* 

The LEFiP staff and some seminar students conducted research into 
the accessibility of the ii/VRC record via several search strategies 
and several data fields* 

The effort associated V7ith reformatting the H4RC records became a 
research project In Its own right since the demands of .the pro- 
gramming system to be used exerted certain constraints which had 
to be studied and overcome or accommodated* 
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Introduction 



This report will not itemize in detail the development of the 
LEEP/MARC Laboratory at Syracuse University. This has been done in 
the quarterly progress reports to the U.S. Office of Education and 
in the four LEEP newsletters Issued during the grant period (see 
bibliography). Kumerous special reports document special develop- 
ments • 



Instead this report will summarize the major developments 
associated with the project, namely, (1) Program and Data Base 
Developments; (2) Class Assignments using Laboratory, and 
(3) Studies on LC/KARC and related Data Bases. Figure I (!'LEEP's 
Role in the Library School'*) puts these three developments in con- 
text. How these three developments grew will be documented in the 
Methods section of this report and the Results and Findings section 
will summarize what happened. 
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Ilethods 



LEEP used the facilities available at the Syracuse University 
Conputing Center* These include two IBM 360 series computers (a 
model 50 and a model 20) , card punching and verifying equipment and 
a mechanical card sorter. 

Details about the IBM 360/50: 

Main memory - 512K bytes 

Disc Storage * 240M bytes (2314 disc unit) 

3 Tape units - 9 Channel (800 bpl max) 

1 Tape unit - 7 Channel (800 bpi max) 

Printer * 1000 1pm (two print chains -* std and TM) 

Card read/punch - 1000 cpm ln/300 cpm out 

There are some thirty IBIl 2741 typewriters tied to the 360/50 
from remote locations around the campus, as well as various other 
terminal equipment, including IBM 2260 display consoles. 



A. Program and Data Base Development 



Several data files form the 


LEEP Tape Library: 




File Description 


No. of Records 


IBM-format 


MARC I catalog 


48,000 


VB 


H4RC I x-ref. tracing 


? 


V 


MARC I auth/tltle 


48,000 


F 


I^C II catalog 


12,000 


VB 


LC Subject Readings 


19,000 


VB 


Biosciences Abstracts 


1,500 


VB 


ACM Journal Abstracts 


70 


U 


(LC) Z-schedule text (60 pages) 


60 


U 



These files, In turn, have been reformatted for use with special 
retrieval or processing programs. The programs written by LEEP staff 
are described below. 5,400 man-hours were spent in several program-, 
ming tasks associated with this effort. Graduate students in the 
Systems and Information Science program were supervised by Frank Har- 
tel, associate director of the project. John Wyman, a member of the 
Computing Center staff, performed the IdARC/DPS work. 



Kinds of Programming Tasks 


% of Time 


1. learning via documentation 


.07 


2. programming 


.40 


3« job preparation (MOLDS, DPS) 


.23 


4. documentation 


.14 


5. instructing 


.08 


6. supervising 


CM 

O 

e 


7. technical administration 


.03 


8. general administration 


.03 



Total Hours 5400 hours»100Z 

Program Suntaarlee 

1. MARC/DPS File Converter (PL/ 1) 

Use with entire IIARC Pilot Project (MARC I) file. 

DPS (Document Processing Sy8ten)ls an IBH natural text processing and 
retrieval system. The DPS data base loader expects "document" Input 
where each document may consist of a set of bibliographic fields 
followed by text organized In sentences and paragraphs. 

The ^lARC/DPS File Converter takes as Input a IdARC I catalog file and 
converts each record into a DPS Input document according to a fixed 
specification. Certain MARC fields are extracted and reformatted to 
produce the bibliographic field content of the DPS document. Be]rond 
this, the total MARC record is reorganized into "words," "sentences," 
and "paragraphs," corresponding respectively to true English words or 
individual data elements other than English words (e.g. numbers), true 
English sentences or the content'^of sl^le MARC I fields (when the 
field content is not really an EngllshTagntcnce) , and groups of re* 
lated fields. 

Diacritical marks and certain non-prlntable delimeter codes are 
eliminated during the transformation from MARC record to DPS document; 
sequential document numbers are generated and affixed to the documents 

At the conclusion of its task, !4ARC/DPS File Converter prints out a 
summary of record characteristics recorded during the conversion. 



2 , LERP-BIBLOLST (Asseably Language) 

Use ^7lth entire ?IARC I file. 

BIBLOLST Is essentially a record-printer program from the Library of 
Congress set of H/IRC I file processing programs. Given a "deck" of 
80-column card images, each containing an LC Catalog Card Number in 
columns 1-11, BIBLOLST passes the sequentially organized file of MARC I 
catalog records, and prints, in an easy-to-read format, the content of 
each record whose LC Card Number matches one of those in the input deck. 
The program uses a 132 character print line, performs over-printing of 
diacritical marks (employing a special print chain), and lists no more 
than one MARC record per printer page. LC Card ihimbers in the input 
deck must be in ascending sequence to match the ordering of records 
in the file. 

For LEEP use, we modified the front end of this program to accept a 
multiple part input deck of LC Card Numbers, each separate part headed 
by a student (i.e., user) identifier card. Each student's deck of card 
numbers is listed on a separate printer page; then the entire set of 
card numbers is sorted (duplicates are retained) and one MARC I record 
is printed in BIBLOLST format for each found card number in the sorted 
list. Unfound card numbers are printed in a single list at the end of 
the record output. Of course, LEEP-BIBLOLST output must be separated 
and the pages reshuffled so that each student gets just that part of 
the run output which is of interest to him. 

LEEP-BIBLOLST does error checking on the input LC Card Numbers; the 
maximum number of error-free card numbers accepted is 477 per run. 

Record output format requires a 132 character line, as in the original 
version of the program. Dlacrlticals are deleted prior to printing. 
Average run time has been three minutes. 

3. MARC I Double Column Lister (Assembly Language) 

Use with entire MARC I file or subset. 

This program prints the entire content of a file of MARC I records in 
a two-column page format; the columns are sixty characters wide and in- 
dividual records follow one another first down the left, then down the 
right column of each page in the order they occur on the input file. 

This lister presents the MARC I record in an abbreviated form, using 
single spacing, identifying information elements by inserting the 
associated tag number in the left margin of the column. On the aver- 
age, six or seven I!ARC I records fit on each page of printout. The 
program processes about 3000 liARG records per minute; actual print 
time, of course, is limited by printer speed. 
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A, LICOSH LISTER (PL/I) 
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Use with LC Subject Headings (7th edition) file. 

This program formats and prints the content of records In the Library 
of Congress Subject Headings file. The urogram obtains (from an In- 
put card) record numbers of the first record In the file to be printed, 
and the last, and lists all records on the Interval so defined. 

5. LICOSH FILE ANALYZER (PL/I) 

Use with LC Subject Headings (7th edition) file. 

This 'program* really consists of a special feature added to the LICOSH 
LISTER orogram to enable the computation of certain statistics on a 
specified Interval of records from the Subject Headings file. The 
neasurements taken are as follows: 

(1) For the LC Class Humbers field (tag 050 on the Subject Headings 
record), a count of the records which contain this field, and, of 
those which do, separate counts to Indicate the distribution over 
LC Classes as represented by the Initial letter of the class code. 

(2) For each of the remaining fields of Interest- 

see References 
sa References, 
also References, 

X Tracings, 

XX Tracings, 

"example under"/"note ^nder". 

Previous Headings, 

—a count of the records 
which do not contain the field, and, of those which do, a histogram 
showing the frequency of occurance of fields containing a single data 
element (word or phrase), two elements, three, etc.; and also, for 
each of the above fields, the average number of elements per field 
and the median number of elements per field. 
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6. FDR (Assembly Language) 

Use with entire HARC I file. 

FDR [Frequency Distribution of I) Records] Is a special purpose 

program which calculates the distribution of the 48,190 !UVRC I records 
over (1) the seven possible !Ialn Entry types, 

(2) the twelve main Dewey classes, and the hundred principal sub- 
classes (based on first two digits of the class code), 

(3) the main LC classes (based on letter codes), 

(4) the seven possible LC Card Humber dates ('62- *68) 

(5) consecutive Intervals on the range of possible record lengths, 

(6) consecutive Intervals on the range of possible publication 
dates. 
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A special set cf counts are produced with respect to the distribution 
of bibliographies, naps, conference proceedings and juvenile works I 

vlth each of the main Dewey classes. 

A 

7. liARC SEARCH Program (Assembly Language) f 

? 

Use with either HARC I or IIARC II files. 

The MARC SEARCH program Is a prinltlve language processor which per- 1 

foms coQplle-and-go operations on Input programs composed of two types 
of statements; the retrieval specification statement and the list 
statement. j 

I 

4 

Retrieval specification statements are the FIHD statement and the COURT | 

statement; in each of these, the command is followed by a specification \ 

of retrieval criteria in the form of a single Boolean eicpresslon of 
arbitrary complexity. The COURT statement demands only a count of the 
records satisfying the retrieval criteria. The FIRD statement directs 
that the qualifying records be counted and saved as a subset of the 
total file. 



The LIST statement uses the command LIST and serves to specify which 
fields of the qualifying records should be printed and which fields 
should be employed as sort keys to order the output prior to printing. 

The MARC SERACH program is designed to work In conjunction with the 
IBM 360 Sort/Merge Program and a special lister program which prints 
the HARC SRARCH output file. 



Typically, then, output of the MARC SEARCH program is a file of records 
shlch have qualified according to the retrieval criteria, where each 
record In the file has been reduced from a total HARC record to one 
which contains just the fields specified for printing, together with 
those designated as sort keys. This output file is used as input to 
the sort /merge program. The lister program is then employed to print 
the output file from Sort/Merge. 

Vovk on the MARC SEARCH program is still in progress. The design 
Intent Is to provide a relatively low cost capability to search 
either I^!ARC I or MARC II files in their sequential form, and to select 
subsets of these files according to a wise variety of criteria. The 
program will process an arbitrary number of different users* search/ 
sort /print requests at once. 

8. MOLDS DBG (PL/I) 

Use with subset of HARC X file. 



k 



f 



HOLDS (Management On-Line Data System) is one of two general purpose 
retrieval systems with which the LEEP staff has worked over the past 
year. This system accesses data bases generated by the user within 

9 









I 



V - . 






'V ' V 






the following constraints: flies within a data base oust be sequentially 
organized; records oust be fixed length/fixed field; all data values 
must occur In character fom. 

MOLDS DBG (Data Base Generator) Is a fairly extensive progran which 
generates any HOLDS data base from the HARO I catalog file. For a 
given (target) data base, the program accepts a MOLDS file descrip- 
tion VThlch designates: 

(1) the maxlnum number of records to be placed In the file, 

(2) Identifiers (field name and/or field number), field 
lengths, and data types (numberlc or alphabetic) for 
all fields In a record. 



The program also Is given the *nane* of the MARC I field from which 
the data for the corresponding MOLDS field Is to be taken. Option- 
j ally* the user of the data base generator can also: 

I (1) specify whether lower-case characters In a MARC field 

I should be translated to upper-case In the corresponding ^LDS field 

{ for each record produced, 

I (2) specify whether diacritical marks and delimiters should 

be deleted from the data as it Is transferred to the MOLDS record, 

I (3) Include special PL/I subroutines to further transform 

I the data In a MARC field before It Is placed in the corresponding 

I MOLDS field for each record produced, 

I (4) Include a special PL/I subroutine to select, according 

f to any criteria, a subset of MARC I records to be transformed for a 

I given MOLDS file.. 
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Upon constructing the required MOLDS file, the data base generator 
provides summary Information pertinent to the task performed. 

9. Z-TERT PROCESSOR 



Use with Library of Congress Z-Class Schedule. 

This Is a test program package which selects certain lines of text 

(In the t]^ographic sense) from a machine record representation of ^ 

the Z-class schedule and transforms these lines into KWIC indexable 

data. Final output is a KWIC index of terms extracted from captions 

for each LC class number In the schedule. I; 

V. 

The first Input file Is 15 pages of text from LC Z-elass schedule \ 

encoded to Identify a variety of typographical and information ele- 
ments via an IBM h^/ ST system (magnetic tape/selectrlc typewriter). 

Z-TEXT PROCESSOR consists of two separate preprocessor programs and 
a K^JIC IMDEKER package consisting of a Sort/Merge preprocessor and ! 

post processor as well as the IBM SORT/MERGE program. ^ 
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B. Class Asslgnnents and Activities Using LEEP/MARC Laboratory 

By January 1969, the laboratory was available for class use* The 
raost important programs described above were written and debugged* 

Subsets of the HARC Pilot Project file were accessible via OPS, MOLDS 
or BIBLOLST* j 

Habers of the LEEP Liaison staff (three research associates and ^ 

the project director) worked with members of the faculty when they I 

expressed an interest In developing an assignment using the HARC Lab- ] 

oratory* The limitations of the data base (only recent monographs J 

amd a sample at that!) and the potential access of such a file were j 

explained * ; 

During the Spring and Fall semesters of 1969, and the summer | 

session, approximately two hundred different students had such class 
assignments* Some students had as cany as five "LEEP asslgnnents « 

The following summary described the purpose and procedures for each 
assignment* 

Sumaary of Class Asslgnnents j 

L*S* 407 Bibliographic Linking 

Reference Service Purpose : (a) Obtain a listing of titles con- = 

talnlng bibliographies from l£ARC records; j 

(b) Prepare for extension and Inter- 
connection of some of these bibliographic entries 

and the original titles within the MMC data base; | 

(c) Practice bibliographic evaluation* | 

Procedure: (a) Area of Interest was selected by ^ 

Dewey or L*C* class number (root search, AMD, OR op- 
tions) fron MARC file of 1000 records* Records with ^ 

class number and bibliographic note were retrieved | 

using DPS/MARC system; 

(b) Bibliographic entries In these ^ 

titles were examined and MARC X worksheets were cade 

for three English monographs, with added data fields 

for source of reference; I 

(c) Evaluate the bibliographies In 

the books examined as reference tools for a scholar* f 



Subject Searching for Bibliography Preparation 
Purpose : (a) To show how a computer can aid 

In the searching process of preparing a bibliography; 

(b) To help formulate a strategy for 



searching; 
on a subject; 



(c) To discover available material 



(d) To evaluate the findings; 

(e) To practice using a computerized 
reference retrieval system called MARG/DPS* 
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Procedure: (a) Do a subject search In a topic 
suitable for a bibliography; 

(b) Examine records retrieved for 
relevance (Is It really about a subject?) and bib- 
liographic data (docs It contain a bibliography 
about the subject or Is It a bibliography on the 
subject?). 

L.S. 602 Retrieval of MARC records In response to a refer- 

Subject Reference ence question; or aid In preparation of a bibliog- 
raphy In a subject area using the conputer. 

Title Searches 

Purpose : Contrast searching for titles to be 

ordered In BPR and In HARC file. In order to obtain 
L.C. card number, established antry, and full cata- 
loging record. 

Procedure : (a) Search for 12 titles In BPR (1966 
and 1967); 

(b) Search In HARC file (1000 records) 
for 10 (ARD searches of title words), DPSAfMC sys- 
tem, and prepare unit cards for any 5. 

Classification Checks 

Purpose : Check newly classified titles against 
computer-based shelfllst to verify correctness and 
study relationship of classification and subject 
headings assigned. 

Procedure : (a) Assign Dewey 17 Class numbers to 
3 titles; 

(b) Keypunch Dewey numbers In order 
to search shelfllst; 

(c) Scan titles and subjects to check 
how newly classified title fits. 

L.S. 626 Changing (Updating) Class Numbers 

History and Theory and Subject Headings 

of Class, and Cat . Purpose : To show the process of updating the 

card catalog by computer. 

Procedure : (a) Using a computer printout spe- 
cially prepared for this assignment and a list of 
LC corrections, decide which books In the conputer 
store will take the new corrections; 

(b) Indicate whether an existing 
subject heading Is to be changed to a nev? one or 
whether a new subject heading Is to be added to 
the existing ones. 



L.S. 427 
Cat. & Class. 
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L.S. 622 
Advanced 
Cataloging 



LEEP-prenared searches were used In class to compare 
and analyze the application of the AA code In the 
areas of series, corporate entries and analytical 
entries, to compare the Dewey and LC classifications, 
and to demonstrate how Dewey classification is, to 
a limited extent, a faceted classification. 



L.S. 621 Searching for Acquisitions 

Technical Services Purpose t Extract cataloging records from HARC 

files (48,000 records) for titles selected from 
Choice or Library Journal (1967 Issues). 

Pryedure : Cite L.C. card number for selected 
titles (at least 10); keypunch numbers; submit with 
job control deck to dispatcher In Computing Center 
and obtain printout of full L.C. cataloging via 
BIBLOLST program. 
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L.S. 628 

Information 

Systems 



Evaluation of Series 

Purgosei (a) For a given subject, examine 
catalog records for titles In a series; 

(b) Determine quantity of material 
on a subject published In series; 

(c) Evaluate series notes and series 
tracing with a view to setting policy for series 
control. 

Procedure ? (a) Search for subjeAt vla.:‘D?SA!ARCS 
system (5000 social science nomographs). (AND, OR, 
root searches of any descrlr) tors are. possible); 

(b) Examine printout of 50 titles 

(or less) for series notes, publishers series, etc.; 

(c) \>?tlte procedural statement for 
handling series. 

Preparation of Bibliographic Information 
for Machine Input 

Purpose ; (a) Exercise keypunching; 

(b) Simulate preparation of biblio- 
graphic Information for nachlne Input. 

Procedure ; For one MARC I Input worksheet (done 
In L.S. 407) keypunch six data elements follovrlng a 
fixed format. 



Use of Boolean Logic for Searching MARC File 
Purpose ; (a) Practice In use of Boolean 
operators; 

(b) Practice In use of a reference 
retrieval system, e.g., DPS/MARGS. 
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Procedure ; Construct 3 searches*- (1) OR search 
for references found earlier in S.U. library with 
both L.C. card number and in BNB; (2) A!1D search for 
two descriptors possibly in the same document » e.f., 
D.C* class number and L.C* class number, or two 
English language T'Tords that describe a subject; 

(3) OR search looking for sane subject as in (2). 
Compare results and comment on use of tsodiflers 
(root search, specification of field, sentence, 
or paragraph to be searched, etc.) 



Area Studies—Access to Recent Bibliographies 

Purpose ; (a) To show a means of bibliographic 
access using a computerized reference retrieval sys- 
tem as an example of area studies materials on !!ARC 
tape; 

<b) Practice in the use of a compu- 
terized reference retrieval system called IIARC/DPS. 

Procedure ; Working in groups formulate an area 
search through the use of key words (include LC or 
3ev;ey numbers when aT!>propriate) • Consider names of 
countries, geographic areas, religions, peoples, etc. 

It may be useful to include a complete description of ' the 
steps Involved in executing a class assignment to show how the project 
staff worked with the faculty and the students. During the evaluation 
period, this close liaison aid and assistance was highly commended. 

Procedural Steps for LEEP Class Assignment 

1. HARC Data Base and Retrieval Programs available at Computing 
Center. Description of each brought to the attention of the School 
of Library Science faculty. 

2. Faculty member, interested in LEEP assignment, discusses 
possible approaches with LEEP staff member. 



L.S. 605 
Bibliography of 
the Social 
Sciences 



3. LEEP staff member writes draft of class assignment and makes 

5 trial computer run to determine difficulties (if any) and potential 

success of retrieval strategy* 

4. Faculty and LEEP staff member rewrite assignment and plan 

I date for class activity. 

5. Optional: LEEP staff member available in class when assign- 

I nent is made. 

,1 

6. LEEP Clinic (outside of class) provides any additional in- 
struction or assistance needed for student's completion of search 

I strategy or keypunching. 






s, 



14 

















’/ 

i. 



7. MARC/DPS User *8 Manual , available on reserve and for sale, 

provides detailed explanations of data base and DPS language for 
self-instruction. t 

8. Student assigiments are collected and run in batch by LEE? f 

staff. Results are distributed via student mall folders. ^ 

9. Class discussion of results with evaluation of MARC/DPS 
retrieval scores conoared t?ith library catalog searches. 

I 

10. Faculty evaluates results of assignment; discussion with 
LEEP staff results in inodlficatlon of procedures, data base, etc. 

i 

11. End of senester evaluation of all LEEP activities. | 

A specific exanple of one assiJinnent and its evaluation night 
point out how the student sees the assigncent. This follows on 
pages 16-18. Evaluations fron one student group and the faculty . 
nenber .Involved ih^thls assignment follow on pages 19-20. 

At the end of the semester, each student and each faculty 
nenber in the school has been sent the forms found on pages 21-23. i 



V 
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L.S. 605 
Fall, 1969 



ASEk STUDIES — ACCESS TO RECENT BIBLIOGRAPHIES 
PURPOSE OF THE ASSIGNMENT 



1. To show a means of bibliographic access using a computerized 
reference retrieval system as an example of area studies materials 
on HARC tape. 

2. Practice in the use of a computerized reference retrieval sys- 
tem called KARC/DPS. 



GENERAL PROCEDURE 



Each student will vork In a group, responsible for a certain area 
of the world. Each group will prepare at least one computer search 
to retrieve all the HARC records for Its area of the world. Each 
MARC record retrieved should have a bibliography. 



STEPS TO FOLLOW 



1. Read Searching MARC/DPS , a user's manual on the con^uter-based 
reference retrieval system used for this assignment. It should 
answer many of your questions about how to phrase your request in 
a way the computer can understand. 

2. As a group, make a list of all the words and phrases which might 
he included to retrieve all references to your area (see the attached 
sample on the Kiddle East). These would include the names of countries 
geographic areas, religions, peoples, etc. If there are Dewey or 
Library of Congress Classification numbers that are appropriate, in- 
clude these too. 

3. Check your list to see that each word appears in the "HARCS/MARCH 
Index List” (in Che LEEP study carrel outside Room 311). If the word 
does not appear in the Index list, discard it. Remember to think of 
synonyms, words with the same root, etc. 

4. From your revised list, write a HARC/DPS search according to the 
instructions in Searching MARC/DPS . Special help can be found on: 

(a) Information about HARC record and 
tags for data fields. 

(b) Combining keywords. 

(c) Search strategy. 

(d) Search deck. 

5. Before keypunching check your search strategy with a LEEP staff 
mend)er during LEEP Clinic hours (Monday, Tuesday 11-12; Wednesday, 
Thursday 12:30-1:30) or by calling ext. 3965. 



6. Keypunch your search and submit your search deck to the LEEP* 
mailbox. Use the name of one of the group members on the TITLE 
card. Vhen the computer run is completed » the search results will 
be returned to the file folder of the person in whose name it was 
submitted. 



AIDS TO STUDENTS USING LEEP COMPUTER-BASED LABORATORY 

1. Searching MARC/DPS - newly published, a user's mamtal for MARC/DPS, 
explaining our computer retrieval program, DPS, its vocabulary and 
search strategy, and how to interpret and evaluate your search results. 
The manual is available for purchase for $.75 from the Library School 
Office, 119 Euclid, Room 101. There are 30 copies on seven-day re- 
serve in the Reserve Section of the University Library. 

2. LEEP Clinic - a member of the LEEP staff will be available to 
answer questions and help students on Monday and Tuesday from 11-12, 
and on Wednesday and Thursday from 12:30-1:30 in the third floor, 
east corridor of the Carnegie Library. 

3. INDEX TO MARC/DPS SEARCH RESULTS (printouts) - An index to a file 
of over 150 MARC/DPS searches has been prepared. It is available in 
the LEEP library at A-21 Collendale. These search results are Indexed 
by keywords used in search, MARC tags, search structure (weighted, 
compound searches, etc.), error messages received, and library science 
course numbers and Inotructors. 



SAMPLE OF DPS SEARCH ON THE MIDDLE EAST 



List of possible keywords selected (those marked with a * were discarded): 



‘ADEN 
ALGERU 
ARAB(S,IAN) 
ARMENIA 
BEDOUIN 
CYPRUS 
EGYPT (IAN) 
IRAN 
IRAQ 



ISLAM 

ISRAEL 

JERUSALEM 

•jews 

JORDAN 

•KUV7AIT 

LEBANON 

LIBYA 

MESOPOTAMIA 



MIDDLE EAST 
MOROCCO 
•MOSLEM 
•MUSLIM 

•musselman 

NEAR EAST 
•NEGEV 
•OliAN 
PALESTINE 



PERSIAN 

*SINAI 

SUDAN 

CVQTA 

TUNIS (IA» IAN) 

TURKEY 

TURKS 

UNITED ARAB REPUBLIC 
* YEMEN 



SAMPLE DPS SEARCH 



S‘ 



g:- 









% 



is 



e: 

I 



‘I 

>5 



Search Deck: 



U MIDDLE & £AST(+1); 

L2 NEAR & EAST(+1); 

L3 UNITED & ARAB(+1) & REPUBLIC(+1) ; 
L4 TURKEY,TURKS,CYPRUS,SYRIA,LEBANON; 



L5 IRAQ,IRAN,PERSIAN,MES0P0TAMU»E6YPT($) ; 



L6 PALESTINE,ARAB($) ^MOROCCO, ALGERIA, 
TUNIS ($)} 

L7 ISRAEL, JORDAN; 

L8 ARMENIA, ISLAM($) ,BEDOUIN, JERUSALEM; 
*L9 L7 & TIOCNOT SEN); 

*L10 L7 & T30(N0T SEN); 



Lll L1,L2,L3,L4,L5,L6,L8,L9,L10; 
**L12 BIBL($) ; 

4* 

**L13 U2 & T60(PAR); 

L14 U1 & L13; 

LIST OFFLINE,TEXT,SUBJECTS; 



Explanatloa : 

Find MARC records with this phrase. 



Find MARC records with these 
keywords • 

Find MARC records with these 
keywords or with words having 
EGYPT as a root. 



Do not save MARC records having 
ISRAEL or JORDAN in the author 
statement or the imprint. 

Summary statement. 

Find MARC records with words 
having BIBL as a root. 

Save only those MARC records having 
BIBL words in the T60 or T70 state* 
nent notes or subject heading. 

Final sunmary of search strategy. 

Print out the text portion of the 
MARC records and above each, the 
subject headings assigned by L.C. 



* L9 and LIO narrow the search in order to avoid false drops. Since Jordan 
and Israel are relatively common surnames, we have specified that MARC records 
whiich contain these words in the TIO or T30 statements (author or imprint 
statements) be excluded. 

** L12 and L13 will Insure that each MARC record that is printed out will 
have a bibliography. 
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LIBRARY EDUCATION EXPERIMENTAL PROJECT • SCHOOL OF LIBRARY SCIENCE 



HARC/DPS SEARCH RESULTS EVALUATIOH SHEET 

Please examine the results from your KARC/DPS search. After filling 
out the following forms ”inail” it to LEEP or turn it in to your instructor. 
(LEEP's address is c/o PARRS • A*21 Collendale. Use campus nail or our 
mail box in Carnegie, 3rd floor.) - - 



K 



1. Name, course number and TITLE of search. 

• 2. In ^ur own words, what kinds of records were you searching for? 

*3. Number of relevant li^C records retrieved. * 



*4. Number of * questionable* MARC records retrieved. 
*5. Number of nbn-relevant MARC records retrieved. 

6. TOTAL number of MARC records retrieved. 






y o 



£SL 



7. What reasons can you give for the non-relevant MARC records being 

a.g. Rewords too broad, keyword is also an author*s name, etc. 



8. How woul^you*'change your search strategy to eliminate or reduce 
such false 



W<>0 iLikU) A j/. ,fO->Ck.JCL^ V.. CO j^L>LX-^sJ.A^ 

*9. Do you think all of the relevant references would have been retrieved 
. If you B^ade a subject search of a library catalog (assuming all books 
in MARCS are In the library^ ? if your answer is no, please ex- 
plain, in general terns, why you think they would not be retrieved. I 

OJLXX^U-viUfL^ 

sUZxiX^iL I 

c-dwc^tf-cLd^ I 

10. Have you any connents about using MARb^S? I 



c 

h 



^ERIG 



*See other side 

SVPariiqPiiNlVFRSITY SYRACUSE. NEW YORK 13210 TEL: (31 5) 476-5541 EXT: 396,5, 3823 
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Faculty Evaluation 
re: L.S, 605: AREA STUDIES AND MAFC TAPES 



The following inforoatlon might be of interest to the LEEF project. 
The class evaluated the assignment and the conclusions were: 

1. That the assignment fulfilled its purpose as stated 
on the vTorksheet. 

2. That those students i^o has worked with HARC tapes in 
the Reference course did not find this assignment rep- 
etitious. They stated that the more varied approaches 
to the tapes the better understanding they had of 
their potential use. 

■ Those few students who had not used the tapes before 
were enthusiastic, if a bit unsteady the first tine 
around. 

3. The dlass liked the group work (2 to 5 students per 
assigned areas). They adnltted some students goofed- 
off. But as an ungraded assignment they felt this 
was to be expected. 

A. That the worksheet did not take an undue amount of 
tine as compared to other worksheets given through- 
out the course. 

5. That as one means of access to social science liter- 
ature the assignment did not over or under emphasize 
the approach but was well related to other means 
studied. 

A by-product, but one with great potential, cane from a Fh.D. 
history student taking the course as a tool. As a non-to-be- 
librarian and a person who has muddled through complex and 
diverse printed bibliographies his enthusiasm for the potential 
use of HARC II was clearly expressed. His response will be re- 
ported to the history department at the end of the semester 
when he evaluates the usefulness of Bibliography of the Social 
Sciences to his department. 



— Prof. North 



Fora. 2. STUDENT EVALUATION 



BEFOBE YOU LEAVE THIS SUMMER — 



Would you please help LEEP? 

The Library Education Experinental project is winding up its first academic 
year at Syracuse University* We have tried to involve as many students in 
as many projects using the conputer*-based laboratory facility as we could* 
We hope we reached you! Would you take a minute ot two to complete this 
evaluation sheet? Your comsents and suggestions will help us plan for 
next year and help us measure the impact ve have had this year* 



MAHB(optional) 



Yes 



Mo 



No 



Did you use LEEP facilities this summer? 

If yes, was it a class assignment? Yes_ 

If yes, which class? Beg* Ref* 

Beg* Cat* 

Subj* Ref* Other (specify) ^ ^ 

Have you any suggestions for new types of assignments LEEP might develop? 



Tech. Serv._ 
Inf. SystenT 






On your own did you use LE^ facilities (keypunch, LEEP library, MARC records, 

360/50 computer, LEEP staff advice, etc*)? Yes No 

If yes, please describe your use and your project* 






Did you use the LEEP clinic? Yes N o 

Any suggestions about it? 

Have you picked up any new ideas or information as a result of LEEP being at 

Syracuse University? Yes N o 

Please explain your answer* 



If you were asked, would you take a job involving library atuomatlon? 
Yes No Why? 



No 



Is this the same answer you would have given a year ago? Yes 

If no, please explain your change of mind* 

Do you have any suggestions, strong criticism, or comsents to make about LEEP? 
(Please use back for additional comsents.) 



€ 






•I 



Please drop this in 311 mail box! THANK YOU! 
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'l^drm 'a*: .EVALUATION OF LEEP 

by SLS Faculty 

January 1970 



. Vlapressions, intuition, and judgnent are unquestionably sources for 
discovering ideas, but should they be relied on for demonstrable verifi- 
cation of the advantage of one curriculum or teaching device over another?" 
James A* Boblnson in Rossi and Biddle's The Nev Media and Education* 

(pp. 95-6). .. ...\ . 

• , 

Perhaps the following questions may help provide the evidence needed 
to verify claims we might want to make about LEEP and its future use at 
SU/SLS. f :: X 



: 

"Sr- j 

^ i 



KAME: 



COURSE: 



;1. What was your purpose in designing a LEEP assignment? 



J 






i 

f- i' 



2. In your opinion, did it serve this purpose? 
Comments: 



Yes 



No 



t 

% I; 

♦ 



. f* 
! 



3. Did the LEEP assignment 0 |.ccupy more than a marginal part of a student's 
time in your class? , . ^ 



i 

1* 



^ t 

i 

f.:! 

‘ J 

4 i- 






4. If the LEEP assignment had much observable or unusual Impact upon 
any of the students, please describe. 



■4 I 



1 

1. 

t. 



Ui 

k 



• 



, • 



22 



. 



- 






. . 



s ^ 












4 ( 



*4. 



, 1 , 

t 



ifi AlrtAntf liinrfiT t*i fn VnrilVi^ Vi 



I 



5* What were the consequences from the LEEP assignment (e.g.. Increase 
In Interest and involvement in course work or learning of factual 
material)? 



I 

I 



6« If there vere any unanticipated consequences please describe. 



7* Do you plan to continue to use the LEEP Laboratory? 



8« Would you give use your active support for the continuation and 
further expansion of LEEP in 1970-7.1? 



9« If we could begin again, what suggestions would you have fore re- 
designing the LEEP Laboratory and the class assignments related to it? 

^ 

A! 
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Class related activities Included the following: 

'•*. i, .Pli/t fof jjiibrarians 

LEEP sponsored two PL/I seminar series for librarians and library 
students. John flyman, a systems analyst and part-time LEEPer, struc- 
tured the courses to teach only those character-manipulating functions 
available in the programming language. The courses have been non- 
credit and scheduled to fit the full-time student schedule: eight 
sessions once a week for the first seminar; eight sessions in four 
weeks the second. 

. 2 . Student -Pro j ec ts 

LEEP facilities were limited to elementary automation techniques 
except for our DPS programming system for searching and sorting of the 
MARC 1 records. Even with these constraints » two student groups 
approached LEEP. 

One student group Indexed a file of student-produced abstracts 
for over 400 articles about technical services. The students used I 

three facets or characteristics of the Information in the documents: 
type of library (or general); function of technical services; and 
equipment or technique. The students planned coding, standard abbre- 
viations, and format for the indexing records. The information was 
then keypunched. The students used a card sorter and the IBM 360/20 
to produce three alphabetic sections of the index. This index and the 
file of abstracts are available to students in Technical Services 
classes this semester. The work was augmented and revised in the 
Spring semester. 

( 

The second project was the description of 200 titles in a local 
ghetto school library, selected for importance to Negro life and 
urban life. The students applied specialized subject headings, then 
constructed bibliographies by: author, title, grade 3evel, and subject 
headings. These were run through the IBM 360/50 to reformat for easy 
reading and distributed to teachers at the elementary school. 

/;■ 

C. studies on LC/MA RC and Rela ted Data Bases I 




ye began some preliminary experiments with AFL/360, a tine-share \ 

system available on the SU campus . APL (A jProgranmlng Language) is a 
rather intriguing, high level language in spite of its unpretentious | 

name. "AFL/360" designates the system which makes AFL available as a | 

tine-share facility on IBM/ 360 series computers. At Syracuse, AFL is | 

useable exclusively through IBM 2741 typewriter terminals: about \ 

thirty-two of these are scattered around the campus— we have one at | 

the LEEP offices; another is located at the School of Library Science | 

? 

s 
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in the Carnef^lc Library. 



L 



Fron a data processor’s point of viev, the APL language repre- 
sents a very powerful approach to the business of autooatic string 
nanipulation (i.e., the juggling of natural language words and phrases 
by machine), text processing, data input, and data retrieval. Further- 
more, API can be expanded quite readily to conform to the language re- 
quirements of those less intrigued ^Tith logic than with easy-to-use 
information services. 

We generated a small bibliographic file which ve have entered 
into computer storage via the typewriter and which we can search with 
iTord and word-stem descriptors. For example, we can retrieve all 
records citing 'Avram* in the I’lain Entry, or all records containing 
some form of the root, 'biblio-' in the Title Statement, etc. 



We also generated a small file of the text and class numbers 
in the Z classification of L.C. From this we could extract, for ex- 
ample, all class numbers for which the word ’book* appears in the 
caption, or ’library’ etc. 



• V 



The index entries were input via typewriter terminal as two-field 
records: the first field contains the index tem(s) as they appear in 
print (e.g., 'Book lists. Periodical’); the second field contains the 
corresponding class code(s) , or ’see’ or ’see alspj references in the 
index published by the Library of Congress. 



Our search program retrieved whole entries if an input descriptor 
occurs anywhere in the field named. For example, the statement 
’inAGINARY* IN TEBI^S asks for a typeout of all index entries containing 
the word ’imaginary’ (in the field names ’TERMS’). The typed response 
nay be as follows: 

\ BOOKPLATES, IMAGIIIARY Z 995.5 

\ BOOKS, DIAGimY Z 1024 

Mother example: 

’1000’ n? CUSS would get: 

BOOKBUYTOG, WAITT LISTS Z 1000.5 

BOOK PRICES Z lOOO 



r* 



In this way we could determine all class codes associated \7ith a 
given tern or all terms linked with a given class code. 

This was a very small exploratory effort in which we wanted to in- 
vestigate (1) the utility of APL as a language for programming input, 
editing, and retrieval facilities and (2) the value of this procedure 
for studying indexing practices for classification shcedulcs. 



f 
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2, Converting LC Classification Schedule to Machine Readable Form 



We completed a preliminary investigation into the feasibility 
of putting the published LC Class Schedule on magnetic tape and pro- 
cessing the resultant data by computer. In particular, ve were in- 
terested in automatic indexing from the machine readable image of 
the printed page. 

Vance Weaver Composition, Inc., New York, used IBtl MT/ST equip- 
ment ('magnetic tape/selectric typexariter system') to convert a sam- 
ple portion of the Z Schedule by copying the first hundred or so pages 
in their entirety (with additions and corrections inserted). The con- 
version techniques comprised an extension of methods used in the prepa- 
ration of photo-composition copy: typeface is identified, as well as 
line indentions; class code ranges not shovnci on the printed page are 
added, as well as explicit identification of the various types of notes 
and references which occur in the published text. 

The MT/ST tapes were converted, in turn,, to computer-acceptable 
format (using a Digi-Data tape converter). Special computer programs 
were then used to rearrange the text into a format acceptable to a 
KWIC Indexing program: each line passed to the indexing program was 
'identified* by the presence of an appropriate LC class code. The 
final result, then, was an automatically generated index which asso- 
ciated every non- trivial word (i.e., articles and prepositions were 
not accepted as index terns) in the lines selected with the LC Class 
code(s) under which they occur in the published schedule. 

This kind of output could represent a starting point from which 
the human indexer VTOuld proceed to develop cross references with 
added terms, etc. 

3. LEEP Library 

A small library of materials about the Library of Congress Machine 
Readable Cataloging Project (MARC) was established. One purpose of 
this library was to gather information to be used by students and 
faculty in their study of the MARC tapes. Cataloging rules, books 
on the use of Library of Congress classification, and other cataloging 
tools, as well as information on (!ARC I and II formats and on related 
computer programs were available. 

The second purpose of this library was to document the MARC Pro- 
ject itself. We hope to maintain a comprehensive MARC collection- 
articles from books and periodicals. Library of Congress publications 
on MARC, news releases about MARC, and documentation of applications. 

A bibliography of materials was compiled for the use of Interested 
persons in other centers. 
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4. DC-LC-SubJect Headings Used in MARC Pilot Project File 

LEEP progracsaers prepared several listings from the original MARC 
Pilot Project file (48,190 records) and the 8,900 volume HAROS file 
which we used for searching via DPS. 

Every subject heading used In the HARO Pilot Project file Is 
arranged in alphabetical order. Beside each Is listed the DC and LC 
class numbers. 

Example 1 - by subject heading: 

338.01 

658.152 

658.153 
658.15 
658.1508 

332.67 
339.4 

Tvto other arrangements show. In order, every DC and every LC 
class number used. Listed beside It Is the subject heading used. 

Example 2 - by DC number: 



HD82.C29 


CAPITAL 


INVESTMENTS. 




HD39.M57 


CAPITAL 


INVESTMENTS. 


V 


HF5681.C25W6 


CAPITAL 


INVESTMENTS. 




HG4028.C4T45 


CAPITAL 


INVESTMENTS. 




HG4026.W47 


CAPITAL 


INVESTMENTS— ADDRESSES, ESSAYS, 
LECTURES. 


t 


HG4028.C4K38 


CAPITAL 


ItAnSSTl^lENTS— MATHEMATICAL MODELS. 




HC110.C3H53 


CAPITAL 


INVESTMENTS— U.S. 


} 

i 



332.67 

332.67 



H64028.C4K38 

H64028.C4K38 



CAPITAL INVESTMENTS— MA'nMIATICAL MODELS. 
ELECTRONIC DATA PROCESSING— CAPITAL 

INVESTMENTS. 



Example 3 - by LC ntimber: 



332.67 

332.67 

658.15 



HG4028.C4K38 

HG4028.C4K38 

HG4028.C4T45 



CAPITAL INVESTMENTS— MATHEMATICAL MODELS. 
ELECTRONIC DATA FROCESSIt^— CAPITAL 

INVESTMENTS. 

CAPITAL IlWESTtlENTS. 



The book In example 2 Is shown In the LC list (note unique LC 
call number), with another book. 

Several SLS students completed studies of subject scatter using 
these listings as the basis for their terra projects In cataloging ai^ 
bibliography classes. 



The procedure one used Is as follovrs: 

!• Begin with one major subject heading, e.g«, VOMEN. Include all 
sub->dlvlslons used \7ith this heading. 



2, Record different LC and DC class numbers used for books with 
these subject headings. 
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3. Check LC List of Subject Headings to verify use of headings 
and sub-dlvlslons. Note any discrepancies. Also note any LC monbers 

which are given. ^ 

4. Check classification schedules (both DC and LC) to see If 
class numbers fall within a range of numbers representing one "group" 
or class. Record captions for each class number. 

5. Check index to classification schedules to note access to 
subject and class numbers available. 

i. 

6. Check "classified catalog" or "shelflist" of MARC Pilot 
Project File to study what other books have been classified In sane 
place as books for this subject. 

j 

7. If possible, examine catalog and shelflist of a library to 
find books in MARC sample and check their placement with other books 
spanning a broader time period than MARC file. 



8. If possible, run HARCS/DPS searches to check retrieval of 
books on this subject by keyword (not subject heading or class number). 

9. Tabulate data to answer certain questions. 

Questions to be answered: 

1. Under how many different class numbers In LC and DC can books 
on a given subject be found? 

2. Within a DC or LC class how many different subjects can be found? 

3. Does a sample study In MARC produce results similar to a library 
catalog study? 
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4. Does practice follow the instructions and Index directions In 
the LC and DC classification schedules and the LC List of Subject 

Headings? f 

j" 

5. VThat factors contribute to subject scatter In a library's i 

arrangement of materials? 

!' 

A different procedure was followed by another student: j 

/ 

1. Begin with a sample of references listed under the same DC 
class ntmber. 



2. Check the LC class number given for each of these references. 



3. Analyze the make-up of the DC and LC class schedules in the 
neighborhood of these numbers. Determine the extent of similarity in 
subject grouping. Which classification is more specific? Could all 
the references be "automatically" reclassified from DC to LC? 
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5. File llanaReaent Exercise 
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5. File llanaReaent Exercise 

As a basis for discussion at the 1969 ASIS Annual Meeting on the 
functions and capabilities of various file nanageraent systems, W. 
Douglas Clinenson Initiated a project in which Interested groups 
might test their own data management and retrieval systems with a 
comon data base and a connnon set of processing tasks. Since the 
LEEP project staff worked with two such systeQS**lf)IiDS (Management 
Online Data System) and DPS (Document Processing System) — we were 
Interested in participating In this exercise. As it turned out, we 
found we would be unable to meet the required completion date and 
so (regretfully) excused ourselves after a preliminary analysis 
of the tasks Involved. 



Nevertheless, In view of the wide disparity of opinion as to 
the kinds of processing a file management system should be able to 
do, we found Interesting and somewhat enlightening the results of 
our examination of the exercise requirements and our cursory evalua- 
tion of our systems in this context. 

The project's common data base consists of three files. Two of 
these comprise the main file of 65 "old" records and an updata file 
of 6 "new" records to be added. Each record contains both fixed and 
variable length fields and represents an article in either the Journal 
or the Conounlcationa of the ACM, 1968. Included in a record are 
record number, journal name, volume and issue number, publication 
date, starting page, title, author (s) with affiliations, abstract, 
keywords and phrases, and category numbers from the Classification 
System for Computing Reviews . 

The third file contains the text of the Classification System 
for Computing Reviews . 

The participants were asked to use their own systems to build 
the main file, update it with the "new" records, apply corrections 
to individual reesrds and to individual fields, within records, in- 
clude the Classification System file In the data base, produce list- 
ings from the file, and process specific inquiries against it, dis- 
playing the results in various forms. 

The following three sections serve to sutxnarlze the specific re- 
quirements of the exercise and also to show the extent to which MOLDS 
and DPS might be expected to satisfy these requirements. 

Data Base Maintenance! 

• • ^ 

Naturally, both MOLDS and DPS have features which enable the 
loading of initial files, and the adding of new documents to an 
existing file. However, neither system provides for modifying parts 
of records in the data base (e.g., to add a new author's name to the 
author field). 
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File Listings t 



The exercise required that the following listings he produced 
fron the data base: 



1. A bibliography showing publication name, volume, issue nuaber, 
starting page, author (s), and title; this listing to be ordered by the 
first four items (major to minor sort keys). 

2. An author index, ordered by author name and including title, 
publication, volme, etc.; articles with multiple authors to appear 
in the index as many times as there are authors. 

3. The classification System for Computing Reviews , citing under 
each category the articles classified under it. 

4. A permuted title index of all articles such that the title 
contains at least one of the key words or phrases assigned to the 
article; to be ordered according to matched words. 

Both I'lOLDS and D?S turned out to be exceedingly weak with regard 
to producing these kinds of listings. DPS, in particular, has no 
feature enabling sorted output. 

File Searches : 

The following indicates particular retrieval problems and, on 
the right, our estimate of the ability of MOLDS and DPS to solve them: 

Problem MOLDS DPS 

Find all records citing JACK as publication impossible easy 
and the word "transform” or "transformation" 
in the title or abstract and which also cite 
"500" as a class code; display full record. 

Find all JACM records with "morph" within impossible difficult 
any word in the abstract; display full record. 



Find all records citing any two of six easy easy 

given class codes: if such a record cites 
CACM as the publication, display certain 
data items, if JACLl is the cited publica- 
tion, display alternate data items. 

Find all records citing no classification easy easy 

codes; display full record. 



Find the record for the most recent CACM 
article containing "debugging" in the 
title; display full record. 



somewhat quite 

difficult easy 
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Find all records with one or the other 
given word pairs in the abstract either 
in the sane sentence or with no nore 
than ten words intervening; display 
full record. 



Find all records containing either in the 
abstract or key^rord field at least one 
word from each of two given lists; display 
certain items from the qualified records. 

Count the records which show publication 
date between two given dates and have cer- 
tain words in the abstract and do not have 
certain other words in the abstract; dis- 
play full record. 



MOLDS DPS 

very easy 

difficult 



very easy 

difficult 



very easy 

difficult 



V 



I Find all records containing an author's 

I name beginning with *’Hu?ho”, where any 

I letter may appear in the position; 

I display selected items from each qual- 

ified record. 

I 

I Find all records T*»ith or "Inter- 

national Business T!achines Corporation" 
I as author's affiliation and "Mew York" 

[ as affiliation state; display selected 

f items. 

I 

[ 

Find all records which have no author's 
! affiliation other than "Harvard Unlver- 

[ slty"; display selected items. 



difficult quite 
easy 



easy easy 



easy easy 



.i' 




Find all records with. at least one of a 
given set of keywords and phrases; display 
selected items at^ order by number of 
matching xfords per record. 



diffidult 



very 

difficult 



Find any record containing the class code 
"3.70"; then find all other records contain- 
ing at least one of the other class codes 
cited by the original record; display selec- 
ted items and order by class code, records 
citing multiple class codes displayed once 
for each code. 



very 

difficult 



very 

difficult 
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6 . Index of )!tARC/DPS Searches 



M index to a file of over 150 KARC/DPS Searches was created 
for student use. Access to searches is provided fron several points 
of viev: keyword used, ?^IARC tags sr^eclfled, DPS search structure 
(truncation, yjeighted, compound, etc.), error message received, and 
library science course number and instructor, ^jlhen possible evalu- 
ation foms are also Included in the file. 
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Results and Findings 



A, Statistics on Computer Osage of SLS/HARC Laboratory 

The pro!»raianers ' tine on the conputer reveal the amount and 
expense of background, work before such. a conputer‘-based laboratory 
can be made available. The programs listed In the previous sec- 
tion on methods are shown here In terns of minutes of computer 
time consuned: 



Those who wish to evaluate DPS as a software system nay be in- 
terested in some of the statistics we have kept. We have Installed 
DPS on an IBM 360/50 machine which has a 9-cablnet 2314 disc storage 
device (as well as tape units) among its peripheral equipnonts. Our 
data base at first consisted of 5,179 bibliographic records selected 
fron the l!ARC I tape; in their source fom these records have an 
average length of 500 characters. 

DPS disc storage requirement for this data base is about 16.8 
million characters, representing a gross storage overhead of nearly 
6 to 1. The data base consists of four internal files: the 'master' 
file, dictionary, vocabulary (an inverted index), and the 'text' file. 
The dictionary consists of 8,465 entries, where class numbers, dates 
and even tag identifiers qualify as entries in the same sense as do 
conventional English words. 

The DPS software requires another 10,000 characters of disc 
storage: 5,000 for programs and 5,000 for working data sets and in- 
termediate files used by the programs during execution. 

Data base programs are distributed more or less uniformly over 
three IBli 2316 disc packs, so that a little less than 202 of each 
pack is devoted to the total DPS system. 



Program 



Minutes 



1. !I0LDS UPLEMEST 

2. MOLDS DBG 

3. LEEP-BIBLOLST 

4. L.C. SUBJECT HEADD16S 

5. FDR 

6. !i\RC-SEARCH 

7. UARC/DPS FILE CNVTR. 

8. MT/ST KWIC IMDER Z-CLi\SS 

9. DPS BlPLEtiEtrr 

10. DPS D.B. LaVDIMG 

11. DPS LOADING (UPDATE: 3800 rec 
12 APL:I/P, EDITING, SRCH. 



1000 

300 

200 

250 

150 

600 

500 

100 

50 

1000 

500 

100 
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For a thoroughly experienced DPS systen programer, the process 
by vjhich our 1!ARCS file (5000+ records 0 500 characters) is trans- 
formed into a DPS data base requires about two hours of 360/50 
nachine tine. 



The updating of the file to 8,200 records consumed 500 minutes, 
only 213 minutes of which were successful loads. This job was done 
by someone less experienced in the DPS systen. 
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The classroom use was heaviest for two programs: EIBLOLST and 
MARCS/DPS. DPS statistics for non-programmer use are as follows: 

Size of Data Base : Spring and Summer 1969— Approx. 5,200 MARC I 

records in social sciences, generalia, bibli- 
ography and library science. 

Fall 1969— Approx. 9,000 HARC I records combining 
above file with records from humanities. 

Class Use : Spring 1969—6 classes — approx. 100 students 
Summer 1969 — 6 classes — approx. 100 students 
Fall 1969—9 classes — approx. 180 students 

Search Statistics : 

Definitions ; Job«contputer run of batched searches 

Search»set of DPS search statements from Individual 





1 


2 


3 


4 


S 6 


7 


Spring 


11 


242 


22 


35 . 5sec . 


20 $.11 


$2720 


Summer 


10 


201 


20 


32 sec. 


14.3 $.13 


$1.84 



1. Number of Jobs in the sample used for statistical study. 

2. Number of Searches In 1. 

3. 2 divided by l»average number of searches per job. 

4. Computer time per search. 

5. Average number of documents retrieved per search. 

6. Approx, cost per document retrieved. 

7. Cost per search. 

Because of a shift in methods of computing time and costs ve cannot 
offer comparable statistics for the fall semester. Instead, in a 
look at34S searches we find an average of 7 searches per job; an 
average of 4 minutes running time per job and an average of 1.35 
minutes of CPU time per job. 
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B, Evaluation by Students 



A questionnaire (Form 2) was sent to all students registered in 
SLS courses at the end of the Spring and Slimmer sessions. The re- 
sponses from the 100 students provided the following information: 



75Z had used LEEP facilities, 75% of them for class assignments 
and 25% for independent work. 33% had used the LEEP clinic. Those 
reporting class assignments checked Beginning Reference (22), Begin- 
ning Cataloging (13), Technical Serivces (20), Information Systems (14),. 
Subject Reference (2), and Advanced Cataloging (6). Some students used 
LEEP in more than one class. 

66% had picked up new ideas and information as a result of LEEP. 
Some felt they had a better understanding of computers in libraries 
(6 respondents), and others felt their fear of computers had lessened 
or been overcome (6 respondents). 



1 



64% would take a job involving library automation. 32% indicated 
that this is not the answer they would have given a year ago. The 
reasons given for these positive answers include: automation is the 
key to library efficiency in the future (16 respondents); the challenge, 
interest and excitement of the field (12 respondents). 

In comparing the summer evaluation sheets with those filled out 
by last spring's students, we find that the percentages are similar. 

The major variation is that fewer summer students did independent 
work than the students in the spring. This probably reflects the 
limitations of time during the short (six-week) summer session. 



At an evaluation session in January 1970, students commented 
that the assignments in various classes were too alike and they hoped 
that more analytic problems or processing routines would be introduced 
in the future. They expressed some of their frustrations associated 
with the assignments but felt it was worthwhile and helped them over- 
come their fears of "the machine." They expressed an interest in a 
short course at the beginning of their first semester where some basic 
skills could be learned and then assignments in each class could re- 
late to some special and unique project. 
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One professor included the following question on his final exam: 
Write a brief concise essay on your Interaction with LEEP. Do not 
confine your response only to your experience within this course. 
Discuss how LEEP (relative to other automated systems) has affected 
your attitude toward library automation. The students who chose to 
answer this question echoed the criticism heard at the evaluation 
session and wondered if the experience was hampered by too snail a 
data base. Again the students wished more could have been done with 
what we had. The responses show a fair understanding of the system,, 
although its potential use within a library school environment was 
less clear to the students. They admitted LEEP helped them overcome 
fears and Interested them in knowing more about library automation. 
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C, Evaluation by Faculty 



% 



The degree o£ sophlsilcecion which the students have gained in 
autonated retrieval via this computer-based laboratory varied be- 
cause each class' effort was subject to the ultimate purpose of the 
classroom assignment. These purposes included: 

1. Retrieval for mechanized retrieval testing alone; 

2. Retrieval for cataloging purposes: 

3. Retrieval for analysis of bibliographic information; 

4. Retrieval via traditionally inaccessibly information on 
the catalog card vd.th the end view to document retrieval 
from the university library stacks. 

The first approaches used in class assignments were shotgun 
approaches: broad searches, citing as many synonyms as possible, in- 
cluding few limiters such as field tag specification in the MARC 
record. 

The teaching of the entire DPS system, although seemingly ir- 
relevant to the student for some specific class assignments, was 
still a necessary first step to any assignment. The problem faced 
was to instruct the student in basics: first, he needs to know the 
DPS language, and then search strategy: how to broaden his subject 
or search criteria to the farthest extreme, and then how to limit 
his search down to the specificity which will exclude some documents 
which would be "false drops." With no one comnon course, it was 
difficult to bypass a "skills session" in each course. 

Our experience with liARCS/DFS instruction pointed to another 
needed area of common instruction: instruction into the nature of 
the data base; first as HARC I records, and second, in terns of the 
"descriptors" available. 

Using Form 3, the faculty responded favorably about LEEP assign- 
ments and their continued use of the laboratory. They highlighted 
the problems of working with a sample data base (only 9,000 records 
of recent imprints), and the spectrum of different student skills 
and experiences with computers. 

An unusual conse<}uence noted by one faculty member from a LEEP 
assignment was the revealed weakness in understanding sub-headings 
of subject headings. She felt that most of the students had not 
absorbed this from the beginning cataloging course. 

At an open evaluation session in January 1970, the faculty 
expressed a need to learn more about the potential of such a "MARC 
Laboratory through their own experience or via demonstrations. 

They expressed some willingness to prepare integrated assignments 
so that individual course assignments would not be so repetitive. 
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If 6xpanded» they hoped that research interests could be served too< 

Further randoQ notes iron this evaluation session include: 

Impact of LEEP is greatest on the student's first encounter with it. 
Problems occur when some in the class have had greater contact T^th 
it than others. 
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Suggest: all students have a touch with it in an introductory course. 

There's a need to know MARC's capabilities. For example^ where*.oan 
they find samples of what they could use in their particular course. 

LEEP is like a library school having its own library for experimental 
work. 



With a broader base of knowledge, the student could use LEEP for any 
assignment he thought it night help in. 



I 



Suggest: two levels of assignments: 

1. Simple at the beginning of his career to overcome fears. 

2. Specialized in the courses dependent on the subject matter 
of the courses and the data base. 

Can we cooperate more with the University library? 



There is a need for meetings of all university people Involved in 
teaching about computer usage. 



Dean Greer: What is required to maintain the current effort? to add 
to the data base? (job descriptions, money etc.) 

Three levels: 1. hands on experience 

2. specialization in courses 

3. research for anyone Interested 



Faculty from twenty other library schools met at Minnowbrook in 
October 1969. They were presented ^Tlth a review of how much time, 
money, people and commitment were needed to mount a project the size 
of LEEP. Some of them are considering implene^lng several LEEP 
programs at their institutions. A few expressed an Interest in 
doing MARCS/DPS searches and a LEEP-by-Mall arrangement was drafted. 
(As of January 1970, three library schools have used this service.) 
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During the summary at Hlnnowbrook someone made the following 
statement: 

"One giant LEEP for Syracuse, ' . 

one small step for library education." 
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Conclusions and ReconmendAtlons 



**THE FUTURE will be different, if we make THE PRESENT different.’* 

Peter l^arvlns 

A computer-based laboratory using HARC tapes and other data was 
developed and used at Syracuse University. By the end of the eighteen- 
laonth grant period, over 250 students and twelve faculty member s had 
used It for course work in cataloging, reference, bibliography, tech- 
nical services, and inforcmtion systems. 

The TIARC Pilot Project data and related files were used. Many 
retrieval searches were analysed and the structure of cataloging 
records was scrutinised. Ilany students idio would have said **no*' to 
a Job involving library automation changed their minds because of 
these aealgments. Faculty member e with no background in computers 
worked with eyeteoe programmers and research assistants to design 
Gonpttter-baeed assignments and provide students with this experience. 

Figure 2 describe?, may of the accomplishments and possible 
future plans of such a laboratory facility, but many questions about 
future developments have been raised. 

At Miniiosd>rookt a Library Education Network was mentioned. Al- 
though our original objective was to explore the possibility of ex- 
changing programs, personnel, or even data bases with other schools, 
this now seems remote because of the divergent developments at various 
library schools. Computing facilities, program languages used, and 
research and curriculum orientation are very disparate, (see appen- 
dix A and B for special LEEP survey) 

The main question is, along what lines should such a laboratory 
expand. 

To date the program systena we provided the student have been 
operable in the batch mode of computer processing. The LEEP staff 
has prepared retrieval programs and placed them in ausillA<F stor- 
age along vrlth data bases. Students have cone to the Computer Center, 
prepared job decks and input data, and have submitted their jobs as 
new members of the university-wide community of computer users. The 
students have been Instructed (by LEEP staff) in the use of the various 
equipment available at the Center, Including keypunches and the IStl 
360/20 computer (which, unlike the larger laodel 50, is operable by the 
students, themselves). They have become familiar with the procedures 
of job submittal and pickup, and certainly have gained a sense of con- 
fidence and familiarity in these areas. Hore significantly, they have 
been introduced to some of the vigors and rewards associated with auto- 
mated retrieval systems. 
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SYRACUSE UNIVERSITY 
SCHOOL OF LIBRARY SCIENCE 
LIBRARY EDUCATION EXPERIIiENTAL PROJECT 



[Moreover, viewed In the context of prevailing developnental costs, 
it should be apparent that LEEP lab facilities have been provided 
at ninlnal expense* The following two factors have nade this accom- 
pllshnent possible: 



(1) we have utilized pre-packaged software systens such as 
llOLDS, DOC-FROC, and the LC ^!ARC I Pilot Systen, and have adapted 
our student assignnents and related activities to the constraints 
Inherent in prograas which are not tailored to our specific needs, 

(2) we have restricted ourselves to the utilization of systems 
which do not make abnomal demands on either the operating systen or 
computer center operational procedures (l*e* , we have implemented 
software to operate in batch processing mode and to interface with 
conventional input/output devices only)*] 

However, there is certainly a sense in \diich batch processed in- 
formation retrieval leaves much to be desired both from a pxfactlcal 
ooint of view as well as from an educational one* 
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For example, in an ideal retrieval situation, the user specifies 
a search criterion without knoxd.ng how many items will qualify for 
retrieval* Therefore, to specify further that all items retrieved 
should be printed may result in unwieldy and costly printouts of more 
records than could be examined in printed form* The user may direct 
that 'If more than 50 items are retrieved, do not print,' or 'Print 
only the first 50 items found,' etc* We may presume, however, that 
the user would wish to analyze the items retrieved according to some 
general characteristic and then make a decision as to which, if any, 
he would want displayed. In general, this kind of decision cannot 
be made in advance of the computer run* In batch mode, beside the 
obvious risk of sustaining charges for the processing and display of 
unwanted results, there is the problem of having to resubmit and 
wait several hours for output again and again before pertinent 
information is derived from the files. 



In a V 7 ord, off-line retrieval applications are less than adequate, 
both from the point of view of the user and that of the teacher* 

Therefore, we would strongly recommend any future expansion of 
the idea of a HAtEC laboratory in a library school should feature the 
Inplexaentatlon of on-line, interactive retrieval facilities in addi- 
tion to the refinement of systems already developed* Prolonged em- 
phasis on off-line retrieval systens would be equivalent to training 
librarians in clerical skills at a time when clerical tasks are fi- 
nally being taken over by non-professional librarians and machines* 

A second major question is the development of a Librarians' 
Language (LL), as a beginning toward an information retrieval lan- 
guage in which the emerging 'librarian/ information scientist' can 
best express the logic and procedures of data retrieval* This should 
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be a high level, powerful language specific to the needs of informa- 
tion retrieval to the extent that these needs are currently under- 
stood, couched In a vocabulary of operations presumed to be meaning- 
ful to librarians In particular. The development of language fea- 
tures, consistent syntax and English language constructions to repre- 
sent logical operations should be the goal of any subsequent research 
along the lines described here. 

Whether the results of this development effort should be trans- 
ferred to other library schools may be a moot point, but somehow the 
measured impact on library science curricula should be felt. Bibli- 
ography classes in today's library schools should Involve firsthand 
use of automated retrieval systems. Students In cataloging courses 
should become involved in analysis of form of entry, subject access, 
comparative classification, and Input of !!ARC records. Technical 
services classes should Include some activities which demonstrate 
the use of the computer as a tool In acquisition, cataloging, etc. 
Tollowlng analysis, comes evaluation and information systems classes 
should begin to teach librarians how to diagnose the attributes of a 
library system, how to assess its accuracy and deterioration of sane. 

The value of libraries axid of library education needs to be 
assessed. In some small way, LEE? may have contributed something 
to that effort. 
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rHie "School of Library Science established a computer-based 
laboratory for library science students utilizing the LC/MARG 
(Machine-Readable Cataloging) magnetic tapes* Assignments In 
several classes (reference and bibliography, cataloging, and 
technical services) Involved the use of these tapes and specla 
purpose programs at the Computing Center. With the aid of 
these computer programs, over two hundred In eight different 
courses (repeated for three semesters) were able to search and 
retrieve!, catalog records for current literature, to process 
their own cataloging assignments or examine the characteristics 
of the Library of Congress cataloging. The laboratory's use- 
fulness was evaluated by the students and the faculty at the 
end of each semester. The entire laboratory (computer program 
data bases, class assignments, user manuals, etc.) has been 
fully described to other library schools at a special institute 
and via a newsletter and report series. 
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